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ABSTBA( 

/ The third-party evaluation presents assessment of the 

first bjcle of operation of the Experience Based Career Education 
(EBCE)/ at Wichita East High School. Twenty-two process objectives and 
twelve outcome objectives were evalugited with either a nominal 
(yes/no) assessment of status, or a descriptive 
(sta^^istical/narrative) assessment of status, as determined by 
interviews with program personnel, examination of project records, 
and/ administration of appropriate instruments. A pre- posttest "design 
was used to assess outcoae objedtives achievement associated with 
academic achievement, self-esteem, career orientation, and sex bias. 
A /self- administering checklist/open-ended response form was used to 
collect summative impressions of the program from studeflts, parents, 
and site resource people. Pre- posttest EBCE/control, results are 
.provided for the Differential Aptitude Test, the tareer Development 
/Inventory, the Coopersmith Self-Esteem Inventory, and on the sex-role 
socialization questionnaire. Results of the parent evaluation, 
-student evaluation resource surveys, cand interviews conducted with, 
resource persons at the work site are reported. It was concluded that 
process and outcome objec^ves wfere_ substiantially accomplished. 
(Appendixes contain detailed descriptions of procedures and data for 
five outcome objectives.) (TA) 
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EXPERIENCE BASED ,CAREER\EDUCATION J ■ 
AT WICHITA EAST rfiGH' SCHOOL: / , / 

• • A THI^RD PARTY /EVALUATION / . 

I " Purpose . / / 

■ / ' / - 

This document has been prepared by third party/ evaluators ^or the 

■ / ' / - / ^ ' ^ ' / ' 

purpo^fe of presenting the ^ssess^ient of^the -first^.cycle of operation qf 



^ ■ • / 7 

the Experience Based. Career Education (EBCE) program at Wichita High 
Scl?ool East. Th^ program proposal contained, 22 process objectives and 
12 outcome objectives. The main body^oif, this' assessment /document 

■/ ■ • "// ' ■' 

contains a listing of the process and outcome objectives, along with 



'either a/nominal (yes/no) assessment of the objfictives* statuses, or a 

/ " ^ / 

descriptive (jstatistical/narrative) assessment of status* 

■ / ■ , • . ■ / ■ 

V : Overview of Evaluation Procedures 

■ /- 1^ ■ / 

/ The status of process objective achievement /was detennined via 
^ interview wifch program personnel and examinaCio^- of project records. 
Outcome objectives were .assessed via the administration of instruments 
appropriate for assessing the various outcome objectives (See Appendices 
A-F)# A pre-posttest design was used to asisess outcome objectives 
achievement associated with academic^ achievement, self-es^teem, career 
orientation and sex bias. A self-administering check list/open'' ended 
response form was used to collect sumipative impressions of the program 

from students, parents,' and sit e^ resource people. In addition, 10 sites 

/ / 

were visited by the evaluators to iniierview the resource people 

W 

regarding their impreissions of the /program. A detailed summary of tKe . 

■ / 

evaluation procedures constitute Appendix A. 



Five additional appendices detail the measurement and analysis 
prpcedures for Outcome Objectives 1, 2, 3, 11, and 12. They are: 
Appendix B— Pre-posttest EBCE/control results on the Differential 
Aptitude Test; Appendix C — Career Development Inventory, pre-posttest 
EBCE/control results; Appendix D~Coopersmith Self-Esteem Inventory, 
pre-ppsttest EBCE/control results; Appendix E~Parent survey, Student 
^Survey, Resource Survey, and interviews conducted with the resource 
persons at the work sites; Appendix F— Pre-post, EBCE/Control results ^ 
on the Sex Role Socializati'on Questionnaire. 

In the instances where the assessment was accomplished through pre 

and lost testing, the EBCE and. control groups contained subjects of the^ * 

numbers and types described in Table 1, Complete data were collected 

from 40 of 44 EBCE students and 33 students in the Control group. Both^ 

groups appear to be roughly cotriparable in terms of sex ratios, racial 

composition, grade level, plans after high school*, and educational 

levels of parents. Table 2 further supports the assertion that the 

... ^ 
groups resemble each other. Student occupationar aspirations and 

occupational positions of parents show similar patterns. 



TABLE 1 

t 

KRlIQUENiy DISTRIBUTIONS I'ROM THE 
CATEGORICAL VARIABLES 



Variables 

Sex 

Male 
Female 



EBCE Group (N=40) 
Frequency Peircent 



22 
18 



55.0 
45.0 



Control Group (N=33) 
Frequency Percent 



15 
18 



45.5 
54.5 



Race 



Wljite 
Black 
Spanish 



82.5 
15.0 
2.5 



24 
7 
2 



72.7 
21.2 
6.1 



"Grade Level 



11 


3 


7.5 


0 


0.6 


12 


37 


92.5 • 


33 


100., 0 


Plans After High School 


o 








None 


0 

1 


2.5 


0 


9.0 


Work-Full Time 


9 


22.5 


10 


30.3 


Work-Part Time 


1 


2.5 


0 


0.0 


Apprenticeship 


2 


5.0 


0 


0..0 


Military Service 


1 


2.5 


1 


/ 3.0 


Vocational -Technical School 


- 8 


20.0 


2 


/ 6.1 


Junior College-Academic 


1 


2.5 


2 


/ 6,1 


-^Junior College-Technical^ 


1 


2.5 


0 


/ 0.0 


. College-University 


16 


40.0 


18 


/ 54:5 



Father's Education 



Do not- know 


1 


2.5 






Elementary School 


•1 


■ 2.5 


1 ; 


' "3.0 


Some High School 


6 


15.0 


7 / 


21.2 


High School Graduate 


13 


32.5 


9 / 


27.3 


Some Post-Secpndary 


6 


15.0 


8 / 


24.2 


College Graduate , 


9 


. 22.5 


5 / 


15.2 


Some Graduate Work 
Advanced Degree' 


0 


0 . 


0 / 


0.0 


4 


10.0 


■ 3 / 


9.1 
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Mother's Education 



MBCE Group (N-AO ) 
F requenc y Percent 



Control Group (N= 33) 
Frequency Percent 



Elementary School 










Some High School 


2 


5.0 ' 


.5 


15.2 


High School Graduate 


15 


37.5 


. 12 


36.4 


Some Post-Secondary 


14 


35.0 


.9 


27.3 


College Graduate 


8 


20.0 


4 


12.1 


Some Graduate Work 


0 


0.0 


2 


6.1 


Advanced Degree 


1 


2.5 


1 


'3.0 


Sibling Drop-outs 










0 


32 . 


80.0 


29 


.87.9 


1 


6 


15.0 


3 


- 9.1 


2 


. 2 


5.0 




3.0 
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TABLE 2 

FREQUENCY DISTRIBUTIONS FOR CAREER 
ASPIRATIONS AND CURRENT PARENT OCCUPATIONS 



Occupations 



E BCE Group (N=^0) 



Control Group (N«33) 

Student Father Mother Stude nt Fa ther 



1. 


Clerical 


2(5.0)1 




14(35.0) 


1(3.0) 




2 


w^^oi. upperson 




"7 / 1 *7 C \ 

7(17.5; 




2(6.1) 


2(6.1) 


O 

J* 


Farmeir 












A 


Homemlker 






12(30.0) 






c 


Laborer < 


1(2.5) 


6(15.0) 


1(2.5) 


2(6.1) 


3(9.1)' 


I 6 


nanager 


I/O c \ 

1(2.5) 


5(12.5) 




1(3.0) 


2(6.1) 


" 7 


niixtaty 




3(7.5) 




2(6.1) 


4(12.1) 


8. 


Operative 


1(2.5) 


2(5.0) 




1(3.0) 


5(15.2). 


9. 


Professional 


15(37.5) 


8(20.0) 


7(17.5) 


19(57.6) 


?(27.3) 


10. 


Proprietor 


1(2.5) 


3(7.5) 






1(3.0) 


11. 


Protective 














Service 1 ^ 


1(2.5) 


1(2.5> 






2(6.1) 


12. 


Sales 1 


2(5.0) 


1(2.5) 


2(5.0) 




2(6.1) 


13. 


Service 1 


1(2.5) 








1(3.0)"" 


14. 


Technical 


3(7.5) 


2(5.0) 


3(7.5) 


3(9.1) 


2(6.1) : 


15. 


Do Not Kilow 


9(22.5) 


2(5.0) 


1(2.5) 


2(6.1) 





Mother 
8(24.2) 

15(45.5)' 

1(3.0) 

1(3.0) 

4(12.1) 

1(3.0) 



2(6.1) / 
1(3.0) •/, 



llhe number inl parenthesis Is the percent of the total. 



Assessment of the EBCE Program Objectives - 



Process Objectiv e 

1. To hire staff (instruction- 
al and director) by Septem- 
ber 30, 1976. 

2. To formalize technical as- 
istance subcontract with 
AEL by September 30, 1976 • 

<i 

3.. To formalize subcontract 
with third-party evalua- 
tor(s) by September 30, . 
1976.- 



^^'^Accomp- 
' lished 



Not 

Accomp- 
lished 



Note 



4. To sponsor all project staff 
to CKatleston, WV, for train- 
ing, by AEL*s staff to be com- 
pleted by October 15, 1976. X 

5. To acquire AEL/EBCE materials 
by October 15, 1976. X 

6. To conduct sex-bias and sex- 
role stereotyping awareness 
workshop for staiqf by October 
31, 1976. , * ' X 

7. To have operational by Nov- « 
ember 15, 1976, an EBCE \^ 
learning center capable of 
housing three learning coor- 
dinators, 60 students and 

the placement • coordinator ^ 
analysts. Director of Opera- 
tions » and secretarial/cler- 
ical personnel. X 

8. * To conduct by- November 30, 

1976, a workshop on tech- 
niques for the elimination 
^ of sex-bias, and sex-role 
stereotyping and methods for 
sex-fair guidance in the op- 
eration of the program. X 

9.. To complete by December 16, 
. 1976, the development of 
those components of the EBCE 
instructional delivery sys- 
tem necessary to implement 

«^ the program locally./ X 



Cdnducted 2/17-19, 
4/13-16, & 6/12/77 



Accomp- 
lished 



Proc ess Objective * 

XO. * .To develop by January 1, 

1977, at least 45 community 
ejjperience sites in which 
EBicE students* can be "placed 
for both academic credit 
an^ career exploration. 

• 1 

11. To ^identify in at least^lO% 
of the local experience 
sites individuals in non- 
traditional job roles 
where EBCE students will be 
placed, i.e. male telepaone 
operators, female plumber. 



12. • To have operational by Jan- . 

uary 9, 1977, the adapted .AEL 
system for placing EBCE stu- 
dents in community experience 
. sites. X 

13. To have recruited students 
for second semester implemen- 
tation by January 9, 1976. X 

14. To conduct EBCE student or- 
,iehtation during the week of 
January 17-21, 1977. X 

15. To finalize the individual- 
ized learning plans, develop- 
ed by the student and his/her 
learning coordinator,, by the' 
end of the orientation (Jan- 
uary 17-21, 1977). X 

16. To have 90% of the EBCE stu- 
dents placed on an experience 
site pursuing their individ- 
ualized programs by the end 
of EBCE orientation (January 
17-21, 1976). X 

17. To prepare quarterly reports 
and quarterly budget reviews 
on October 1, 1976; January 
"1, 1977; April 1, 1977; July 

1. 1977. , X 



Accomp- 
lished 



Note 




60 sites were devel- 
oped, ' 



E,G. Women in manage- 
ment roies, female po 
lice officers, males 
in baking research. 



100% were placed. 



Assume July will; be 
completed on-time/ 



Process Objective 



Accomp- 
lished 



Not 

Accomp- 
lished 



18, To implement, by January 21, 
1977, the evaluation proced- 
ures necessary for the docu- 
mentation of the effective- 
ness of the program. 

19* Recruitment for the 1977-78 
school year of students and 
students* parent sign-up doc- 
umentation will be completed 
. hy May 15, 1977. 

20, The third party evaluation 
^ report will be prepared and 
ready for' submittal by June 
30, 1977. 



Note 



See Appendix Ar 
Procedures* 



Still in progress* 



21* The annual report and budget 
review will be completed by 
June 30, 1977. 

22* The project continuation 
application and budget re- 
quest for FY 1978 will be 
prepared and submitted by 
June 30, 1977. 



Outcome Objective 
OUTCOME: 

1. EBCE students will demonstrate 
equivalent or greater gains 
In basic skills than compar- 
ison group students. 



EBCE students will demonstrate 
equivalent or greater^ gains 
in career maturity than com- 
parison group students. 



EBCE students will demonstrate 
equivalent or greater gains in 
attitudihal development than 
comparison group students* 



Result 

I 

Six of the jeight pre-post DAT sub- 
scale comparisons did not differ sig- 
nificantly* The subscale scores for 
space relations and language usage 
dif^-ered significantly in favor of 
the control group* (See Appendix B). 
The objective was substantially 
accomplished. 

The EBCE students had a significantly 
larger gain in the planning orienta- 
tion subscale score of the career" de- 
velopment inventory than the controls. 
There were no significant pre-post 
differences for the two remaining 
subscales* (See Appendix C)* Ob- 
jective accomplished. 

The EBCE students demonstrated a sig- 
nificantly-larger gain in the "jjen- 
eral" subscale of the SEX than did the 
controls* There were no significant 
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Outc ome Objective 



4^ Students will use instru- 
ments such as Work Activr - 
iti es Checklist , Work Sit- 
uation Checklist , Values 
* instrument , and Chart for 
Relating School Subjects 
and Oc c upations to assess 
career > educational, ahd^^ 
personal needs and inter- 
ests and will use the data 
' to develop academic 'and 
career experiences. 

5. Students will use instru- 
ments such as the Basic 
Skills Inventories and the 
GATE (short form) to assess 
career, educational, and 
personal aptitudes and will 
use the data to develop ac- 
ademic and career exper- 
iences* 

6. Students will observe var- 
ious career requirements, 
restrictions, and oppor- 
tunities through experience 
site placements and docu- 
ment these characteristics 
by completing related activ- 
ities in the Student Career 
G uide * They will then use 
the data in developing 
viable career plans. 

7* Students will determi^ne ^he 
necessity of basic/ reading 
and mathematics sl/ills for 
various careers at exper** 
ience sites and then util- 
ize scores .from the ?.asic 
Skills Inventories to 
select learning^ object- 
ives necessary to master 
those skills essential 
for rewarding career op- 
portunites* 



Result 

differences on" the remaining 3 sub/ 
scales or the over-all scvores* (See 
Appendix D)* Objective accoraplistted* 

Interviews with project p«sonne^and 
perusal of project records indicate 
^that this objective was accomplished* 
Some nejgative student feedback was 
noted for these activates* (See! Appen- 
dix E)* Objective accomplished./ 



The Basic Skills Inventory was/ used in 
its entir.ity* The. math portion of the 
GATE was used* Parent response to pro- 
vision of the kind of experience were 
positive* (See Appendix E)* /objective 
accomplished* . / 



The physical evidence supporting the 
assertion that this objective has been 
accomplished is available* / Feedback 
from student'^ suggests, hoWever, that 
they fail to fully appreciate the value 
of the activitfies and prodiicts associ- 
ated with this objective* / (See Appen- 
dix E). The value of this type of 
activity should be assesse^d over the 
longer term. 



Interviews with staff andf project rec- 
orilr indicate that their 'objective was 
accomplished. Some of the DAT sub- 
scale scores measuring the skills in 
question do not verify the accomplish- 
ment of the objective* Thg. process was 
followed, but the outcome was not 
achieved as measured by the DAT (See 
Appendix B)* 
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Outcome . Ob j ec tive - , ^ 

8. Students willodevelop Ac- 

' /, tivity Shedts which utilise 
basic skills and/or academ- 
ic learning in conjunction 
with available activities 
at e^cperience sites* This 
. integration of basic 
. skills/academic learning 
and' experience site activ- 
ities will result in. the'' 
application of refinement, 

. , of basic skills/academic 
learning developm^ntV " 

9. Students will utilize var- 
ious instruments for as- 

, sessing personal* needs, in- 
terests,, and aptitudes, 
, - will participate in career 
'exploration through exper- ■ 
\ ience site .placements, "and 
'will complete \he Final 
^Review activity in the 

• Studgnt Career Guide. as a 

• function of generating 
preliminary career plans 
which are informed ^nd 

. L ■ 



realistic 



Result ; / , ' " \ 

The record of achievement on their ob- 
jective is mixed. Some feedback in , - 
^^pepdix E complements Ithe relationship 
between work and study while other feed- 
back criticizes it* Thfe dominant ten-, 
dency'iri the feedback. is for a -stronger 
relationship between work and study* 
This objective requires additional^ 
attention for its satisfactory accomp- 
lishments. 



4^ 



Feedback, fxom students, parents and re- 
source persons confirm that this objective 
was achieved. This area of activity marks 
one of, the major accomplishments of the 
project/^- 



10. Students ^will participate 
in career placements at * 
- experience sites and will / 
: engage in academie actiy- / 
it-ies which riela,te to ex- 
perience sites in the 
decisioa-making process , 
antecedent . to -the selec-/ 



/ 



/Objective accomplished • 



tion of a career . f ield ; 
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Parents, students, em- 
:.ployers, labor ^union, and 

other involved community " 

memberij will demonstrate a 
^positive attitude towarjd, 
"and continual support o;f , 

the'^EBCE program. 



Interviews with personnel at 10 sites, 
plus written feedback from 22 additional 
site resource persons, 12 i>arent€r; and 40 
s/udents confirm^ the accomplishment of 
this objective. ^Some parent feedback 
was particj^arly^noteworthy in terms of 
gratitudeV^xpressed for keeping a pot en- 
'tial dropdut in school, changing a neg- , 
ative attitude io a positive one and' 
so forth*!^ Several- of the respondents 
in face-to-face Interviews indicated 
that they would b^>enthu.<«iastic about, 
having their own child^piirticipate in 
EBCE; The program to joys substantial 
support among* 'its .cons.tituents. (See* : 
Appendix E)v > 



^Outcome Objective 



Result 



12, Students part^icipating^ in 
* the EBCE program will par- 
ticipate, during orienta- 
' tion, in sex bias, sex- 
role stereotyping smalf- 
group workshops and will 
demonstrate a greater 

r , awareness and acceptance 
of, and participation^ in 
non-traditional job-roles. 



Using the Sex Role Socialization quest-, 
ionnaire, the EBCE students showed gains 
no different from the control groups on 
sex stereotypes (See. Appendix F)/ The 
EBCE students ciid participate in the- 
workshops and did participate or observe 
non-traditional job-roles. Objective, 
partially accoiraplished. 



12 



Conclusions. ^ • 

All but pne of the process objectives were accomplished at. or above 
the target cnriteria. Most of the outcome objectives were met and the 
remainder approached the values set before the program started. Therefore, 
the process and outcome objectives were substantially accomplished* 



/ 
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U ' ' ■ . -• ■ ■ ' ■ ■■■■'I' 

- - /■' ^- ■ ■ , ■ ' ■ . . '..-/' 

/ Procedures , * . ^ /- 

Outcome objectives 1, 2, 3, and 12 were evaluated with a pretest- * i.: 

posttest, treatment-control group design. Malcolm B. Young and Russeil , 
Schub ^1975) describe this type of design as being able to provide an * . 
accura|:e assessment of the impact of the program, if the...pretest differ- 
ences/between participant and ' comparison groups are due to chance. 

/ ^ . ' / ' > / .4 ' . - ' . ^ ^ : 

/outcome objective 11 iras ev^aluated with a sjirvey design. Young and • 
Schub note that this type of design can provide a Stescription of ' ^ ' . 

quaiiit^tively-supported estimates of various groOto characteristics. ' -i. 

- / ' - ' - " ^ ~ - . / -/ ' - ' . 
J Other process and outcome objectives were evaluated with a descrip- . \\ 
tive design. Existing matetials, files and records were examined to'^ ^ ^:v' 
-^^etermine objective attainment, - ^ ' V \ 

'y- " ' • Sampling " ' ' 

Instruments selected for use were simultaneously administered to ' 
the 44 treatment and 33 control students. in a common setting/ The . 
evaluators administered the instruments and collected the responses. - . 

The pretest w|is admiriistered during mid-Jahuary, 1977, a date which " ' V 

coincided closely with the start of thSe program. The posttest was ' x .\. /- 

administered during the first week in M^, 1977. Similar testing con- ^ \ t/ 
ditions preva^^1|ed during the pretest' and^ pokttest sessions. / ^ y. 

Parents, students, and persons with whom student! worked at 
experience sites comprised populations, from which suryey and interview 
data were gathered. Opinions of these groups were sought only at the 
end of the year. . / > 

> 

* • * Data Analysis ^ 

Outcome Objective's 1, 2> 3, 12. > . ' - 
^ *» . ' * . ^ 

^ The analysis procedure for the pretest-post te^t, treatment- 
control group design was analysis of covariance. Tfffs^ technique 
statistically Controls within-group variance dnd also controls for 
lower-order interaction effects'. The post test mean scores for Che 
treatment and control groups wera^ coif pared with the P test while , 
statistically controlling (coyafying) the differences in pretest scores 
for sex and socioeconomic status. Results are reported for the nine 
su'bscales of the Differential Aptitude Tests (Form S, 1972 edition), 
the three subscales pf the Qareer Development - Inventory; the four 
subscales of the Cobpersmith Self-llsteem Inventory, along with a 
total value ^f or the. SEIi ;and; the four subscales of the ^ Sex Role s ^ 
Socialization Questionnaire. 
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' * Outcome Objectiv e 11 . 

. t> . * 

Descriptive.^statistics and qualitative procedures were used to, 
evaluate this ob^e^tive. Frequency and percentage distributions alohg 
with narrative conslitute the analysis techniques » 

* ' OtHer Objectives . 

^ ^ The remaining process and outcome objectives were evaluated with 
data gleaned from program files and records. "^Narrative analysis and 
'checklist summaries were used to evaluate these objectives. 

* i ' / / Reference ' 

Malcolm B. Young and Russell 'G. Schub. Evaluation and Educational 
Decjgs ion-Making; A Functional Guide to Evaluating Career Education , 
(Washington, D.C*: Offic^of Education/DHEW, 1975). t 
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APPENDIX B 
DATA FOR OUTCOME OBJECTIVE 1 • 
EBCE students will demonstrate equiva- 
lent or greater gairis in basic- skills 
•J 

fhan comparison group students. 



\ 
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/ Instrumentation " 

/ The Differential Aptitude Test (DAT) provi'ded comprehensive 
measure for Outcom^ Objective 1. Eight different subscales constitute 
the DAT: verTjal reasoning, ^numerical ability, abstract reasoning, 
clerical speed and accuracy, mechanical reasoning, space relations, . 
.spelling, and language usage. In addition, the verbal reasoning and 
numerical ability subscales are cdmbined .to form a composite Indicator 
of general intellectual ability. • ' 

The DAT, particularly the verbal reasoning and numerical ability 
subscales, has been estahjlished and demonstrated by means of strength / 
of correlations of subscale measures^ with 'course 'gradfes. The subscale^ 
reliability coefficients for the two forms of the test range from .89/ 
to .97 (senior males,, form S) , .88^ to :96 (senior females, form S), ./89 
to-.96 (senior males, form T) ; and .88 to .97 (senior females,^ form JT). 

Results ^ , • ' 

Table^ 3 contains the data summary for .evaluating this objective. 
The £BCE and the control^ groups differ significantly on only two of the 
nine subscales - spac6 relations and language usage/- In both instances, 
however, the adjusted posttest scores for the contrpj! group are higher. 
For the mechanical reasoning subscale, ^the EBCE tendfed to improve more 
than the control group ^mechanical reasoning (p=.I4). 

' lo summary. Outcome Objective 1 was mostly supported. Wit.h two"' 
exceptions, the: EBCE students demonstrated .equivalent gains in basic 
skills to the control group students. 
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TABLE 3 



Means, Standard Deviations (SD), and Analysis of Covariance Summaries for 
the Differential Aptitude Test (DAT) scores Across the EBCE and Control 









Groups • 










-DAT 


EBCE 


: 




Control 








Subscale 


Test 


Mean 


SD ■ 


. Mean 


SD 


F 


P 


Verbal 


Pre 


46.0 


•28.8 


57.6 


35.6 


.OA 


.84 . 


Reasoning 


Post^ 


48.5 


29.-0 . 


58.2 


35.3 




(VR) 


, Adj. 
. Post 


53.2 




52.3 








Numerical 


Pre 


49.5 


30.8 


59.1 


39.1 


2.09 


.16 ■ 


Ability 


Post ' 


47.6 


31.4 


^4.0 


34.3 • 






(NA) /. 

i ' 'j 


Adj . 
Post 


52.0 




58.6 








Cbmposlte 


Pre 


46,9 


28.7 


57.8 


39.1 


■ .62 


.44 


Post 


46.6 


29.6 


60.2 


35.1 








. Ad j . 
Post 


5i.3 




54.3 








Abstract ^ 


Pre 


48.6 


26.4 . 


59.7 


30 : 8 


".77 


.38 


Reasoning 


Post 


48.6- 


26.6 


64.2, 


28.5 




• \ 


Adj. ^ 

^^Past 


"53.1 


> 


58.5. 








Clerical 


Pre 


56,5 


27.6 


53.6 


34.9 


.06. 


.80 


Speed and 


Post 


53 i 8 


29.0 


57.2 


34.4 






Accuracy 


Adj, 
Post" 


54.4 


• 


: 56.4 








Mechanical 


Pre 


, 43.2 


25.0 


65.7 


26.6 


2.28 


.14 


^ Reasoning 


Post 


53.7 


27.1 . 


65.2 . 


29.6 








Adj . 
Post 


62.8 


! 


53.8 


< 






Space 


Pre 


48.7 


27.3 


48.3 


' 32.6 


7.46 


.01* 


. Relations 


;Post 


. 49.9 


.. 26.8 


61.6 


32.5 








^Adj. 
Post ^ 


49.1 




- 62.5 








^ Spelling 


Pre 


' 45". 3 


27.7 


49.9 


35.2 


.09 


.76 



Post 
'Adj. 
Post 



50.7 
53.7 



29.9 



58.9 
55.2 



35.0 



er|c. 
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Table 3 continued 



Language . Pre 
Usage Post 

Ad j . 

Post 



33. A 

38. ^\ 



29.1 
27.8 



1 



Adj. Post = Adjusted Posttest. 
k 

Significantly different from zero. 



53.0 
55.3 

48.9 



35.2 
38.5 



7/. 26 



.01 



/ 



•> 'V- 



r 



ERJC 
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APEJENDIX C 
DATA FOR OUTCOME OBJECTIVE 2 
EBCE students will demonstrate >equiva- 
lent or gx/eater gfain^. in career Wtur- 
ity' than comparison group s.tudent^* 



erIc 



'V 
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Instrumentatioii 

The Career Development Inventory (CDI) was 'employed to evaluate 
Outcome Objective 2. This instr\iment wds developed by^^Donald E. Super 
and his associates ^to measure three components of caVeer development. 
The three subscales are the following: -planning orientation, resources 
for exploration, and information and decision making. The students 
complete thxs*fonn in about 30 minutes. Established reliability and 
validity characteristics support ^the use of the CDI for evaluating 
outcome objective number 'two. • - 

Results 

A , . . 

Table 4 summarizes the data analysis results for Outcome' Objective 
2. The EBCE had.a greater gain in-the planning orientation subscale 
score than the control group. ^ The adjusted means are .115.1 and 98.3 
respectively. No significant differences were found for the C^) 
resources for exploration and (b) information and decision making 
subscales. Therefore, the objective was .accomplished. 
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TABLE 4 

Means, Standard Deviations (SD), and Analysis of Covariance Summaries for 
Career Development Inventory (CDI) Scores Across the EBCE and Control Groups 



CDI 




EBCE 




Control 










Subscale 


Test 


Mean 


SD 


Mean 


SO 


F 


P 




PART I — ■ 

Planning 

Orientation 


Pre 
Post- 
Adj/ 
Post 


92.4 
. 113.7 

115.1 


19.0 
20.6 


96.3 
100.1 

98.3 


24.1. 
, 26.2 


12.2 


.00* 




PART II — 

Resources 

for- 

Exploration 


Pre 
Post 
Adj. 
Post 


277.5 
302.2 

300.2 


43.7 
47.7 


265.8 
309.6 

312.3 


66.7 
32.2 


.6 


.44 ' 


\ 





PART III — Pre 


16.6 


4.5 


15.2 


6.0 I 


1.36 


.25 




Information Post 


16.6' 


6.0 


17.0 


4.3 








and Decision Adj . 


16.1 




17.6 


£ 






t 


Making Post 











Adjusted Post Test , ^ 

k 

Significantly different from zero. 
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APPENDIX D 
DATA FOR OUTCOME OBJECTIVE 3 
EBCE students will demonstrate equiva- 
, lent or greater gains in attitudinal^ 
development than comparison group stu-, 
dents. " 



V 



26 





Instrumentat ion 



The Self-Esteem.4nventory, Form A (SEI) was used to .measuri^ Oatcome 
Objective 3. This instrument, developed by Stanley -^oopetsSni^ J' ^ 
contains 58 items and four subscales. Form A provides an ksfeessment of \ 
self-esteem using four components general social self-peers, home^r^ 
..4>aEg}t:s, and school-academic. ' |— Alr^ ^ ' 

The items are short statements, generally answered "like me" or • 
unlike me". The split half reliability ranges/from .87 to .90. Test- 
retest reliability estimates range from .64 (12 month intervals) to s88 • 
(five week intervals), in addition, convergent, discriminant, and ' 
predictive validity types h?ve been established. On the basis of studies 
conducted to date, SEI scores are significantly related to creativity, - 
academic achievement, resistance to grdui^^ .and other important vari^Bles. 
This.. provided a reliable and valid measure' for outcome objective number ' 
three. / /, 



Results ^ : , 

: The ddta analysis summary for Outcome Objective 3 constitutes 
Table 5. The EBCE students demonstrated a significantly larger gain 
(p=.05) than the control student's on the general subscale of the SEI. 
No significant differences were found'f or the remaining three subscale 
or the total f core. Therefore, Outcome Objective 3 was accomplished. 
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TABLE 5 



Means, Standard Deviations . (SD) , and Analysis o£ Covariance Siimnmries for 
Self-Esteems Inventory (SEI) Scores^ Across, the EBCE and Control Groups 



the 





^ SEI ^ - 




EBCE 




-Control 






■ •■ ; 




\ Subscale 


Test 


JJean 


Stf 


Mean 




F 


p . 






Pre > 


38.7 


11.3 


.43.1 


7 8 






t 


General 


' Post, 

AO J . 

Post 


43^2 




42.5 

An A 


7.5 

* « 




•\ ■• ■ ■ 




, _ 







_^ , 














^. Pre 


12.8 


3.3 


13.2 


3.3 


.1 


.80\ . 




Social 


Post 


13.4 


3.0 


' 13.6 


2.8 










. Adj. 
Post 


13.6' 




13.4 . 




< 


•y . 




^ « 




















Pre 


9.0 




11.2 


4-2 




It \o 




Home 


Post 


10.5 


4.1 


13.0 


3.6 










Adj. 
Post 


11.0 




12.3 












































Pre 


8.4 


4.5 


918 


3.5 


.4. 

c 


.52 . 




' ' Academic 


Post . 
Adj. , 
Post '"^ 


9.8 

io.i 


4.2 


11.1 
10.7 . 


. 3.0 
























Pre 


68.7 - 


20.5 


76.9 


16.5 


.9 - 


.36 ' V 




Total 


Post 


76.9 


18.5 


80.2 13.9 






Adj. 
Post 


79.5 




76.7 









Adjusted Post Test 
. Significantly different from zero. 
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Parents^, students, employers, -labor 
uni6n> dnd other involved community mem- 
bers will* demonstra'te a positive attitude ' 



toward, and continual support; of,, the /, : 




TABLE 6 



.SUMMARY OP PARENT RESPONSES 

f . ' 

EXPERIENCE BASED CAREER EDUCATION EVALUATION 
WICHtTA EAST HIGH SCHOOL* 



Agreement 



Disagreement 



QUESTION 



Strong Mild Neutral Mild Strong 
% of % of % of %,of „ % of 
totaP total total total total 



1;'^ The- results of the EBCE 
\ program .were generally 
worthwhile. " 

2. The EBCE program pro- ' 
.duced positive .attitudes 
and academic achievement, 

3. The EBCE {nrogram was run 
efficiently. 

4* * Student needs and inter--^ 
"ests were given appro- 
priate consideration. 



8(66.65 3(25) 



6X50) 



5(41.6) 0 



8(66.6) 3(25) 



7(58.3) 4(33.3) 0 



0 1(8.3) 



0 1(8.3) 



0 ' 1(8:3) 



0 1(8.3) 



5. Was there any features 
about the way the EBCE 
program operated .that 
you thought particu- 
larly effective, appros- 
priate, or useful? 



Responsesg 



N=YES N=PART N«NO 



10 



0 



Content of ''YES" responses and number of comments ( " ^. 

Positive comments related/to *the variety and value of" the work site 
experiences, including c^teer orientation, the. "rea4' nature" of work. Value 
of education reinforcement, etc. (6) Interest of instructors in meeting 
student needs and efforts to^match work and academic^ experiences (3); 
Aptitude and interest information provided by testing associated with the 
problem. (2); Maintaining interest^ of an older student in school (1); 
Emphasis on academic work (1). 



6. Was there any feature 
about the way the EBCE 
program operated * "th^t 
you thought particu-^ 
larly* ineffective, in- 
appropriate, or use- • 
less? 



■Responses^ 
N«YES N«>PART N^'NO 

2"^ 0 10 ^ 

. ■ : . ■/ 

• / • 



Table 6 continued 



Content of "YES" responses and number of comments (- ) , / 

"The student with a part time job has difficulty meeting all expectations /f 
jthe EBCE program (l);^the first EBCE woKk assignment^ was not satisfactory 
(parent believes this'^will improve as program^" ?natui*es) (1) . . / 



7.. ^General comments or , ^ . < 

suggestions that ResponsesQ \ I 

would help improve Comments No Comment 

the EBCE program? -10-2 

Content of comments and number of comments by category ( ) , 

Three respondents made general comments praising the program-. They cited 
specific benefits such, as: "Getting students away from 'peer pul,l' which 
.causes >so many problems; preventing. one, student's dropping out, improving 
communication with parents and convincing 'the student of the yalue of 
education.; and~"Of all Gov.v5r spor^spred programs this one wiil do more 
for students to realize the. opportunities available and know .their own" 
potential" (3) (these are obviously riot suggestions ^f or improvJ.ng the ^ 
program). Improve the quality and timeliness of communication with 
students regarding school activities, e.g;, notification! s regarding 
c(^mmencement activities (2); Provide parents more program information via 
printed matter or other means such as "opefi houses" (1); Consider changing 
the work/study time ratio to provide more in-^school time (1); Provide 

' greater f lexibili^ty for leaving an unsatisfactory sit€ assignment and 
being satisfactorily reassigned (l)j Provide more feedback to sites to 

•help them serve -s.tudents better and keep them busy (i) ; Take, pains to 
insure that motivation, ability, and part time jobs outside EBCE do not ' 
combine with the" EBCE program in ways' leading to failure r(l). 



@ Responses were jionfent-anaiyzed. Parents provided comments only with a 
^yes"> or "coimnentj^* response. Total N of content may exceed 'Ves*' or 
'"comment" total because of multiple responses ^per respondent. 



TABLE 7 

SUMMARY OF STUDENT RESPONSES 



EXPERIENCE BASED CAREER EDUCATION EVALUATION 
WICHITA EAST HIGH SCHOOL* 



Agreement 



^ Disagreement 



Question 



> Strong Mild Neutral Mild Strong 
% of % af J, % of %■ of, ^ Z of 
total total" total " total" total 



!• .The results of the EBCE 
- program were generally 
. worthwhile. * ^ * ' 

2. The EBCE program pro- 
duce^: positive atti- ' 
tudes and academic 

• achievement • ' 

3. The EBCE program wafs 
riin efficiently. 

c ' ^ 

4* . Stuclent needs and 
^> interests were given 

appropriate consid- 

eration. 



21(52,5). 13(32.5) 4(10) 1(2.5) 1(2.5) 

, . ^ ^- 

19(47.5) 14(35) \ 4(10) 1(2.5) 2(5)- 

17(42.5) 12(30) 10(25) 0(0) '. 1(2.5) 

... • V 

15(37.5) 19(4Z.5) 5(12.5) 1(2.5) 0(0) 



5. Was there any fea- 
ture abbut the way 
■the EBCE program 
operated that ypu 
thought particularly 
effective, appro- 
priate, or useiful? 



Rgsponges@ 



N^YES^ N«PART N«NO 



28 / 



Content of "YES" responses and number of comments ( 

Opportunities for career exploration (14) ;< Positive relationship with learning 
copxrdlnator. (7); ..Individualization of learning experience?, (6); Program 
efficiency CO; Range oiE job j?lacemen't opportunities (1); ^ Opportunity to 7- 
-experience a. variety of work experiences (1); Freedfpm from wgrking people (1); 
The opportunity to emphasize subjects of particular interest (1); Learning to 
work independently (1); Calling parents about even the "smallest thing? 
(a negative compliment") (1). 



Table 7 continued 
Question 



6.^ Was there any feature 
about the way the EBCE 

program operated that ResponsesQ ' . 

you thought particu- N=YES N=PART N«NO ' 

' larly ineffective, in- 12 14 14 

'^approriate, or use- * " 
less? ♦ 

Conten t of "YES" responses and number of comments' ( ) . 

Difficulty of completing academic requirements given work time requirements 
(6); Insufficient resource and reference materials (2); Career awareness 
experiences associated with, program (workbook). (2); Lack of instructor with 
expertise in technical subjects (1); Mandatory, rather than job placement 
by choice (1); perceived lack of organization in making academic assignments 
(1); Perceived l^ck of academic challenge (1); Perceived alienation from' 
school activities because of time requirements on job (1). 



Question « *i 

7. General comment's of 
suggestion that would 
help improve the EBCE 
program? 



Cpnmients 
'28 



■ Responses^ 



No Comment 

^ 12 



Conten t of comme n ts and number of cocfaents by category ( ) . 

Unfocused pdstive comments (6); Increase number and interest level of work 
sites (4), Keep students better informed^ of sqhool activities (4); Improve 
the relationship between work and study (3)^ provide more time for or 
increase emphasis on academics (3); Give more attention to student selection/ 
supervision (3); Shorten the length of assignment ^on-site (2) Unfocussed, 
negative comments (2); Increase variety of career exploration opportunities 
(1); Provide better access to teachers of "my siibjepts (1). 



* N=40 



Q Responses were content-analyzed. Students provided comments only witV a 
^^Yes , i.r "comment" response. Total N of content may exceed "Yes." or 
comment" total because of multiple responses per respondent. 



TABLE 8 ■ 
SUMMARY OF RESOURCE PERSONS' COMMENfS 

•I 

EXPERIENCE BASIC CAREER EDUCATION EVALUATION 
WICHITA EAST HIGH , SCHOOI.* 



Agreement 



Disagreement 



Question 



Strong Mild Neutral Mild Strong 
J, % of % of %'of „ Z of % of 
total total total -total total 



1. The results of the EBCE pro- 
gram werfe" generally wdrth- 

^ while ♦ 

2. :The EBCE program produced 
positive attitudes and 
academic achievement • ' ' 

3» J[ifie EBCE program was run- 
'efficiently. 

4. Student needs and J.nter- 
ests were given appro- 
priate consideration. 



11(50) 9(40.9) 2(9.1) 0(0) 0(0) 

6(27.3) 10(45.5) 5(22.7) 1(4.5) 0(0) 

10(45.5) ^6(27.3) 6(27.3) 0(0) 0(0) 

10(45.5) 9X40.9) 3(13.6) 0(0) 0(0) 



/ 



5. Was there any feature 

about the way the EBCE Responses@ 

.program operated that' N=YES N=PART N=NO ^ 

you^thought particu- /II 3 8 - ' 

larly effective, appro- ' ' 
priat,e, or useful? 

Content of "yes" responses and number of comments ( ). 

Opportunities provided for career orientation (5); Usefulness of the unique 
program concept (2); Clarity of program policies provide for resource 
peopie(l); Evidence of effective student selection (1); Effective student/ 
resource person or,^.entat ion provided by program staff (1); Flexibility (1). 



. Was th^re any feature 
about the wdy Xhe; EBCE 
program operated that 
you thought particular- 
ly ineffective, inappro- 
priate*, li>r useless? 



N=YES 



Response s@ 



N=PART 
0 



N=NO 
15 



34 



Table 8 continued 



• Content of "yes" responses and number of comments . ' ^* 

Carefully monitor student experiences at the work site and provide fiqedback 
to the resource person at the site so modification of work experience* for 
improvement will be enhanced (2); Watch student career interests dnd site 
assignments more carefully via student screening (1) ; Strengthen * 
relationship between work and study^ (1); Provide sites more lead time with 
respect to announcing assignment of new student (s) and duration of stay (1); , 
Provide more specific information regarding the resource person's role -and 
authority over students at the work site (1); Provide<;clearer definition of 
expectations regarding student attendance and responsibiliuy for monitoring 
a^d reporting (1). , 

Question c ^ - ^ 

7. General Comments 6r - . ResponsesQ 

suggestions, that would Comments No Comments 

help improve the EBCE 12 B / . 

program? . ' ' ' ^ 

' Content of comments and number of comments by category •( ) . 

>v^omments related to resource persons' concern with apparent lack of student 
intc^st in site activities (one respondent expressed lack of interest in 
continiied^ssociation with the program if students are not more carefi41y 
screened fot<lnterest in and commitment to site activities) (4)'; General 
comments related to^positive outcomes associated with apparent presence of 
student interest (3);^" References to the amount of time students spend at 
sites being either too little^or^too much (the implication in the two 
foregoing comments seems to be for more .careful assessment of .the interik:tion 
of the complexity of task(s) at the site with level (s) of student interest. 
Varied assignments as functions of the interaction may be indicated) (3); 
Insure that the relationship between work and study is stp9ng.(l); Reduce 
the (appatrently) inordinate amount of paperwork required by .learning 
coordinators and site analysts: "Surely such a good program could be . 
continued with less effort (of this sort) on their part" <1); Excellent - 
opportunity for career exploration (1); Schedule work more carefully for 
students with part time (paying) jobs^(l). - 

Two comments impressed the evaluators as being sufficiently unique to 
warrant direct quotation/ "threer weeks (on site) is a long time. Altljough 
we are rather diversified in what the student cah participate , in, two weeks^ 
would be sufficient to let the student know if the interest Is there." 

"Is the student's original choice of career field necessarily his final 
choice for life? Of course not. I have changed major areas over four times, 
from military, factory worker, .full-time farmer, basic researcher, and now 
applied research. This should be emphasized to^the student. ' You learn as 
you go. ' 



@ Responses were content-analyzed. Resource persons provided comments only 
with a "yes" or "comment" response. Total N of content may exceed "yes" or 
"comment" total because of multiple »-responses per respondent. 
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TABLE 9 

SUMMARY 'OF RESOURCE PEHSON INTERVIEt^ . 
RESPONSES TO THE EXPERIENCE BASE CAREER 



EDUCATION PROGRAM AT WICHITA EAST HIGH SCHOOL 



The results of the EBCE 
program were generally, 
worthwhile. 



Agreement ^.^ Disagreement 

Strong Mild Neutral Mild Strong 
- JJ(%) N(%) . N(%) UiX) N(%) 



9(90) 1(10) 



The EBCE program produced 
positive attitudes and ^ , 
academic achievement. 5(50) 



3(30) 2C20) 



3. The EBCE ^program w^s 
run efficiently. 

4. L'tudent needs and inter- 
ests were given appro-- 
priate consideration.^ 



8(80) 2(20) 



6(60) ^ 1(10) 2(20) 1(10) 



5. 



Was there any feature 
about' the way the EBCE 
program operated that 
you thbught particularly 
effective, appropriate, 
or useful?- 



Responses 



Yes 
LO 



Part 
0 



No 
0 



d. 



Four comment each. f ' j 

-Opportunities for students to explore jobs and test their talents. 
-Interaction of students and resource persons. ; | 

-Feedback from the program staff. | 
-Gaining familiarity with specific types of work and workers*. , 
-Complementing work experience and Academic study ^ , 

' \ . ^ \ 

Threfe comments each. \ 
-The unique nature of work at specific sites. . 
-The uniqueness of the program itself. 

. Two^ comments each . ' 

-Good quality and attitudes of students. 

.-Interact ion of school «ind resource person.- ^ - ^ 

^' 

One commfent each. 

-Student opportunities to, share information /about work. 

-Provision of inTormatiori on job searches. 

^Minimum effort and time required by the resource persons. 
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Table 9 continued 



7 ^ ^ 

6. Was th^re any feature 

. about the way the EBCE Responses"^ 
program operated that Yes Part No 

you thought particularly , • 4 ~ * ' 

ineffective, inappropriate, 
or useless? 

•-^ 

a. Four comments each. 

-Problems. associated with work conflicts between academic and site 

requirements. ^ ' 

;-Spacfe at^work sites. . ' ' ^ 

b. One ^comment each. 

-Greater effort to increase .the value of site expe]c;ience. 
\; -Inadequate planning time for resource person. * ' * . 

7. General comments or suggestions that would help improve the EBCE program? 

4i Three comments each.^ 

-Need for more effective coordination of the time allocated for study and 
work. 

b. Two comments each. 

• * -Use of pre and post interview would help improve on site evaluations. 

c. One comment each. , 

-Introduce greater flexibility into the ability of students to change job 
sites whep thefr interest ^^is low. 

-Make the orientation of .students to job sites more systematic. * 
—Make the work schedule more, regular in terms of daily, rather than 

intermittent experience. . - 
-Increase frequency of feedback from learning coordinator to resource 

person^ 

-Hold resource person coordinating services to reduce duplication of 
-expetience. at sitel 

<? 

General comments ' ■ . 

The overall affective response of resource persons waa quite positive 
and supportive of the program. At least five of the" resource persons said 
they would like their child to parti'cipa'te in the program, and all but one 
(n=9) indicated they would be.^enthusiastic about continuing their relationship 
with the program next year. One resource person indicated plans to terminate 
a relationship with another program in order to place'more effort oiv the EBCE 
effort. 
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APPENDIX F 
DATA FOR OUTCOME OBJEGTlVi 12 
Students participating in the EBCE pro- 
gram will participate, during orienta- 
tation, in sex bias, sex-role stereo- 
typing small-group workshops aM will 
demonstrate a greater awareness and - 
acceptance of, and participation in non 
traditional job-roles • , , 

it 

I 
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Ihstrumentation 



\ 



The Sex Role Socialization (SRS) Questionnaire provided the 
eval.uation data for Outcome Objective 12. This measure was developed 
by Bf^erman, Brovennan, Clarkson, Rosenkrantz, and Voyel (1970). The. 
36 iteiBs are completed twice by the respondent, once using the items to" 
describe an adulc aale. Twenty-five items are male-valued and 11 
female-valufed.; The items, are scored separately for th'e male and female 
descriptions for the male-valued items and then the female-valued items. 
The result is four subscales: male-male, male-female, female-male, and 
female- female. > 
^ The developers- hold that £he iteas are typical stereotypes of 
socially desirable;'roale and female behaviors or traits. The reliability 
and validity of the SRS supported its use "to evaluate Outcome Objective 



Results - 

. The summary o^ the results. for this objective comprise Table 10. 
None^of the analyses are significant at the five percent . level but two 
approach significance. The responses to the socially desirable items 
for males when us^d to describe males tended to increase' (greater 
^stereotyping) for the EBCE group (pretest mean - 4.7 and posttest mean 
»~~5vO.Mi^a seven point scale). On the other hand, the responses to 
the soclaily^sirable items for. females when used to describe females 
tended to decr^sefor the EBCE students (5.5 to 4.9). Therefore, 
the stereotypes of ffem^es decreased for the EBCE students and remained 
the same for the control^^udents . The conclusioi> is' that no liifffer- 
ences are aipparent between the, EBCE and control groups. 
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TABLE 10 

*■ - 

H«an8, Standard Deviations (SD), and Analysis of Covar lance .Stnnaries' for 
the <Sex Role Socialization (SRS) Scores Across the*'EBCE and Control Groups 



SRS , 


EBCE 




Control 










S'ubscale 


'Test 


Meah 


sp 


Mean 


SD 


F 


? 


Male- 
Male 

* 


Pre 
Post, 
Adj.-^ 
Post- 


A.7 
5.0 
5.0 


•52 . 
.38 


4.7 
4.8 
4.8 

*• 


.41 
.42 


2.6 

It 

■ \ 


.12 


-% 

Male- 
Female 


Pre 
' Post , 
. Ad j . ' 
.Post 


. 4.4 
4.0 
4.0 


.8- 
.8 


< 

4.4 
4.2 
4.2 

« 


.6 
.6 


.8^ 


.37 

'\ 


Female 
Kale 


Pre 

Post ' 
• Adj. 
' Post 


3.8 
3.8 
3.8 


.5 


.4.0 
3.8 
3.4 


- .5 
.5 


.'4 


.52 


Female* ^ 
Female 

i 


Pr4 
Post 
• Adj. 
Post 


5.5 
4.9 
4.8 


.4 
.9 

r 


5.3 
5.3 
5.4 , 


.6 

. .7 

i 

1 


\ 

3.8 ' 

-. ) 


.06 , 



A. 



Adjusted* Post Test ' " 

Significantly different from zero. * 



A 



